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ABSTRACT 


The aim of this thesis is to reorganize what I have learned 
and had in mind concerning the theory of linear programming. The focus 


of analysis is. on the simplex method. 


The first two chapters serve as a foundation of our subsequent 
discussion of the simplex method. Chapter 3 deals with the theoretical 
aspect of the simplex method, while Chapter 4 with the computational 
aspect. In Chapters 5 and 6, geometric and economic interpretation of 


the simplex method is discussed. 


This thesis is not able to claim a contribution to the theory, 
however, all the theorems in the context are reinterpreted, and the 
proofs are modified. All the examples are either originated, or taken 
from exercises in the textbooks cited. I have solved and rearranged all 


the examples to suit the illustration of the theory. 


My first access to the theory of linear programming was led 
by Dorfman, Samuelson, and Solow's "Linear Programing and Economic 
Analysis", however, my later study of Gass's "Linear Programming", and 
Hadley's "Linear Programming" has more influence on my thought and 
Re eneranc ine of the theory. I hope this thesis will serve as a 


stepping-stone to my further study in this field. 


A 7 a =, LL ae 


indupsedva 0.30 noitehevot & ab Svsea BxsIgBd> OW7. aor? sat | 

Sestiercety sis diiw stash € xeagedd bets, Sala silt to nee: 
| Penotsequgmoo sila daly & vedaRdd sibeiy daition sitiiesine i emigasine 7 
jo nobIsserqrveiat simonooy bas okasamaeg. 2 bas 2 exésqadd nt 


oat aie. o3 notmwdiaine mint 03 side som et wilde: ote 


edd bne ,bsisaqyetnies sie Jxssno> sis at emozoaris' sat Lia 

newe2 x0 ,betstigize zedths exe esiquexs sda [LA -botitbom a. soem 

[fg begnsitssy bos bevioe svel IT .battos edoddaxed odd mt eestoiexe wioxt 
exoarta ont to ani serdeub he say tive oF beehoas aP; | 


bat wav gnisabigatg seni 0 ee eid od esd50a dark?) Pd _ 
ghioneod bre ee sesthi a'wole® bite .soalsdmee ft a 

bap <"Sritimassg007 thenki” a'aded Ye ybuiz xsisl ym, ct . TA oe 
ban adguons yma ‘opiate stom gu "gntomengorxd ans 
© ae Sivas hig eked atds etff t i 
“blabi atdg) at ybuse. asdaais wo: 


ACKNOWLEDGEMENT 


I should like to express my indebtedness to Professor B. von 
Hohenbalken and Professor A. Buse for their instruction. The order 
of contents was suggested by Professor von Hohenbalken, He also suggested 
some topics which I did not discuss in the first draft of my manuscript. 
Professor Buse corrected some theoretical and grammatical mistakes which 
I made in the second draft of my manuscript. Thanks also to my wife, 


Yoko, for her assistance in copying my manuscript and drawing diagrams. 


—  Eaonpaey’ od expubsddabat pt aera ab oni 
isbie sf .noktouyiant ited? Jot aud . h fonn shan by ' 
bedeaague vals olf nsijladasdo nov toeestosd yd besaeggue enw 6 
Vqrrosvoam ym io J3avb Jest? sd nt esusath Jom bib I dis tate aotges. amos a: . 7 
dobdw esdesetn (oi isnniag bes Esotiexosly seea boanetzo2 sau toenslort 
,silw gm 03 oats ednadt s3qbtoevaas ym Yo Jlerb bnoses sfd at shew t 
REBT garb gupwtiy bos aqkasevasa we anheos at sonsJebess ued t0Y Godo® 


ae 


CONTENTS 


List of Notation oewoecoaoow#oaeoeoneneececow#vneoeeadne@@naonofoeoeceoeotone oe eo eco eo cae oe foe oe ab 


CHAPTERS se rormularion, Of Linear PrOSTAMS “sos sie cc. 600 01060908 6 6'0:0 88 5 


e 
° 
9 
5 
° 
Q 
o 
5 
5 
°o 
° 
° 
° 
° 
o 
e 
3 


CHAPTER 2: Theory of Linear Programming ---- 
Gf NS SUNT LOT Maret tact etal titel haat Pol ahah chic alchohol atahat ol eaidtchal gt atot eel aratare  fLeL 
G2 weheas DL PiCY "ANd FCONVERLEECY Borda ftdtote dabei c dctenctclc’ of cte matcraetetarere  Glity 
DOmpUnG smen ta lm LMG OUCIS Mer rs <iete esis cs 0.6 Ghettle sc Caio sisi se culeaew “ly 
§4 Existence Theorem, Duality Theorem, and Equilibrium 


Theorem e@ooeaeveweocesvseveeorew Che @©eoceo@eeoet¢ocoeoeeeoneeoeowe We ocecwne oon 8 6 24 


CHAPTER 3i2 Theory of the Simplex Method eo@eeeedeecaoeedceaeeaoeacaeedtsenone@eseeaondwe 33 
81 Initial Basis Feasible Solution and Its Equivalent 
Combinations eeeeoeeee0eeo0oe4ese4#d#keedoednanedgcgeeeee4eeeeeese0eceedn@eseseeeeceae9ene 6 6 6 34 


§2 New Basic Feasible Solution and Optimality Criterion ... 37 


CAL net ee camp LeseandelableyGOMpUCACTON ass ccsceseosaeeeswessace 43 
Seer eM DLCs mer arias Weritettte she ists aleve c cis Ww anes seu ehtlarvie amie ters cra wb 
§2 Basis Formed by Slack Vectors as Initial Basis ...-....-. 65 
PAGE Cle bist PAs ein tal Basta aie sasiovasceckeulicesa Vo 


Cae ternative Onl imal teyaCoLteri0N Gids ces ca chicas been ea ae ae!) FO 
CHAbloke mm GeOMetm@Lce LN CeL DLE At LOU. see sie «5 os su avec teem ae ss ak « 82 
Cicer mmnCONCMMemINLeEEPrObALLON sc veceuece beast ecevesccywGedsasces 4 


REFERENCES Ce ee TOD? 


gay 


Ea 


5 


MTG ha web ONs io t¥e ce oat bee -. ameicadt terhenbbadt £4: Pa 


7p 
; 
’ 


n. : 


SS) CF Goat! Gated eSee 4685 ieee eae 

> a a 
1 PET en eer re race sie aaah oe 
pCR BUS tes ape ny he eae) tro esherteni ‘eo rtd a 


Seid niet vese roy shea emergert znentd 10 aol elumpew 


musi Lipa na pmedbary ek all insted? soneseked BE et 


ort itt, Le VU) ess 7 


letiecesirerescte-ceefea badvalh Salgake of? 20 yaoedt 26 SRPRAND 
Insieviups stl bhi notsitoe aldtenat eiend Isbttnl 12 - 
soe MObYSTIAD ysbismtsg0 bas noksulo2 s(dtesst shaek wat SF 


ss euctvrersevosvensees ROLIBIUGMAD Bidet ine aslquent 
ri redia te vG Pe -@> * CP et we oO Pew eteee @ & (teeny ney Qpliquieaet rt 


reeeccee Blasd Iptiftal en etotoav Asel@ yd bemioy ekeeh $9 
orcs sococCusenevas B68 Setar em skGad Uptebilek Be 
ewe rp tWen bes hae es ce bee HORSE tlemk sq svtimmrsabA i 


aki Gana ckknee tel. svn nh sue ee mnt te 


Weer ass dean pee kat sWnl.tvewiicohe ye ee ie vie : 
= 7 
a a) 
a as Es 
_ - 


- 
=> 
> 
aan Sr) 


LIST OF GRAPHS 


Figure I .. 


Figure*2t ¢ 


Figure III 


Figure IV 


Figure V 


LIST “OF . TABLES 
Tablewie. 
Weave Wie 


Table III 


Page 


js 
is) 


ee 
& 


16 


90 


68 


74 


dd, 


a _ oe 
Sah ee wes rereke tea swes nese eee ek Ten pam sfoee oe 
| <i 
: — _* £ 
Rb ede Shee ree Os wea a's eo Od Shs wy BOOS A OMS iS vee : 
: s - = 


AS RGhAS 06s erEPAM! CEOd etm as? re 


SO OGt Be aes tf saunas) de (entsek eae aen inedeadas <7 
d — 7 
ah — 


Penna hip ee S¥wr~ pe ee hens 1H Deeks One ewe den venalre, * 
€ : 

re 
+. 


: I 
ieee eee beeen Peet ee we nn ee Ret eee eee hee ewe Per he ee r ; 


. = ; > e. Na 
Cee we eR aE ae ewe ee Be Seer orv gd ethene eee s Roitwy a « 
: a 
.s 6 64/e BESERCOPeEC Ee CRC eee eee Seer eee ee TE} alder 


LIST OF NOTATION 


In order to avoid confusion, we list the symbols which will 
appear in more than one chapter in our context. We shall also define 
all the symbols at the places of their first appearance. In this list, 
we shall not define the symbols which appear in only one chapter. We 
shall use as many well-recognized symbols as possible. However we 
also use our own symbols wherever necessary or convenient for our 


discussion. Note all vectors are defined as column vectors. 


A= (a,.) ainatiiss wittlinea oF itas. its)celiementsineil awil,2,...,m; 
shige ti 
q =O. 2.e650s st aM tematic, moevare finite numbers. 
* 2 s ° ° e 
AD =sGQRDr, an mx(n +m) matrix where I is an-identity matrix 
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A =aCde aeahee,. a. .a Seeman aim x seetcolumivector which is’ a écolumn 
j 13°23 mj 
rs 
Pea ih een OL eA em eeY ances es). 2 atl, OF 2 2 6. Ds 
n+i1,...,n +m, depending on the matrix considered is A or A . 


Note in the discussion of the simplex method, es is referred to 
the column vector not in the basis, while A, to the column vector 
in the basis. When the basis contains the first m vectors, then 


dese Dlg lo el 


B an mx m matrix formed by Aj, Pal 2,ee sel oo eLhasamatrixe.s 


called the basis. The subscript r is the index number of basis. 


b = (b, »b Die) aioe x iemcolLunn vector 
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f anumber not greater than k. See rr. 
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n nn , ; ; ; 
k = oy or ( a ) depending on whether the matrix considered is A 
x 
or A . k represents the maximum possible number of bases. 
0 a null vector whose dimension will be defined wherever it appears. 
b index number of bases which can range up to k. When r=f =, it 
indicates the final basis, i.e. the optimal basis. 
S the feasible set, 
vee (Vp oVooeeeeV)! > an nx 1 column vector, the values assigned 
to the variables in the primal objective function. 
ee ay =) (va.V ve.O ) a (n + m) 1 column 
VECEOn. 
Se = (Vy Voseee0v)! , an mx 1 cOlumn vector, equivalent to V when 
* 
the basis B. contains the first m columns in A or A . 
W = b'y , a scalar, the value of the dual objective function. 
Wye se We Gera tinekion oly | 
x = (4) Xo 200+ 9%)! » an nx 1 column vector, the variables of the 
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primal program. 
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when A is involved. 
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to primal program when the basis B. contains the first m columns 


» an mx.1 column vector, the basic solution 
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>; J > mM , an mx LF column vector, the equivalent 
combination when the basis B contains the first m columns 


Aj, 7 Ul ete Ol eA, # | oPetial attention must be paid te the 
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distinction between Xo and ie 


y= (YpoVooereo¥y) » an mx 1 column vector, the variables of the 


dual program. 


fo) ay Le O ; ; 

y = (Y] 9Yooee oY)! » an mx 1 column vector, the optimal solution 
to dual program. 

Z = v'X , a scalar, the value of the primal objective function. 


2 ieee Shae rine 1 One Ome oh): 


i ; : : : 
a= toe » a scalar, the value of the primal objective function when 


the basis B is specified. 


ie is P 5, : 
Ay = ae » a scalar, the value of the equivalent combination when the 
basis is B_. 

1 


r a column vector with elements he » where i is to be specified 


wherever it appears. 
In addition to the above symbols, we must distinguish the 


following inequality signs when we are considering set values, e.g. 


when matrix, vector, or set is involved. 


Ore eeleaicee e Ore) Said 97), 4:.e. the strict 


inequality holds at least once. 
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Finally, the equation number contains two or three parts. The 
first part represents the number of chapter, and the second part the order 
of appearance. The third part, if appears, represents subdivision of 


equations or program. 


CHAPTER 1 


FORMULATION OF LINEAR PROGRAMS 


Let us consider.a linear program as 


Maximize Z =v" x (iret ds) 
Subject to Ax <b Cie) 
x 0 (al iae)) 
Where seAG=a (aa) to— vl 2. wee ees hoe ee stl, 1 = mM, 1 and mare 


finite, x= (X1 9X5 o-2+5%)! » an nx 1 column vector of variables to 


be determined, b = (bj sbay+-+b )J > an om x9l* constant column vector, 
m 
Vi=m (Vee Vette 2) naienerit) constant column vector. ZZ is a scalar, 
deed? eh 
value of objective function v'x . To avoid confusion we define all 


vectors as column vectors. If we want row vectors, we need only to 


transpose our defined vectors. 
WescanmrewritesCrerts) . (iel,2) #and Kl.1.3) as foldows 
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We can partition the coefficient matrix A as 


i We follow the notation A. in Dorfman, Samuelson, and Solow, Linear 


Programming and Economic “Analysis, p. 143. 
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A= (Aj .A5 o> AD) 
a4 
494 
where Ai = : fetes Find. gD 
mj 
We call si the process vector. 
Thus (1.1.2) can be written as 
e 
) acc: 2D 
j=l ah del 
i.e. linear combination of ia =, 2, 00750) 5 With coerficients 
aa = 1,2,...,n) . This expression is very important in our later 


discussion of the simplex method. 


For later discussion we formulate the dual problem of the 


above primal problem as follows 


Minimize W = bly Cle Zal) 
Subjectatog Aly = V (192. 2h) 
we ge 
where y = (YyoYooree eV)! oes column» vector, and 
W is a scalar. 
m 
or Minimize W = ) b.y lee 2a) 
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Subject to » ape ye cea Ceo ay) 
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This kind of expression is very common in the theory of linear pro- 
gramming, e.g. Dorfman, Samuelson, and Solow, op. cit., p. 144. 
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In words, the dual problem is to find a set of non-negative 
yy such that W, 


the value of objective function is minimized, 
undereehneuconstraintas(l.ce2)) and (142.3). 


The above inequalities (1.1.2") can be transformed into equations 


by introducing slack variables or surplus variables as follows 


aes eat 103 = 
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Zea *on*n *n+1 *n+2 . *n+3 *i+m 2 
ge sdenrct, + Q: meray ype + = Db 
#n1*1 enn *n+1 *h+m-1 *o+m m 
where Re oka are the slack variables, and the corresponding 
process vectors Ang? Aan 
ficient matrix becomes 


are unit vectors such that the coef- 


x 
A = (A,I) 


and the variable vector and the v 
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vector become 
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x = (Xj 506+ 5% x 
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n+1 


Thus our primal problem can be written as 
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Max vik'xk (i113) 
Subject to Z*x* = b (1. 29 
x* 20 (iio) 


where (1.1.2") is expressed in equalities. Similarly we can transform 
the dual problem into the form of equalities, except the new coefficient 


matrix is 


AY, =) 


We call the added process vectors and the corresponding 


variables surplus vectors and surplus variables. 


The introduction of slack and surplus variables and vectors 
will help us find the real optimal solution, and will help us undertake 
table computations. We shall discuss the importance of slack, surplus 


and artificial variables in Chapter 4. 


Finally, notice should be taken of three points: 


1. The above formulation is of standard (symmetric) form. If formulated 
in canonical (unsymmetric) form, the variables of the dual problem 


need not be constrained to be non-negative. 


2. The canonical form is written as 


max Zea x Crh See 


i] 
ion 


subject to Ax : Cig 332) 


: Gale, The Theory of Linear Economic Models, p. 76; or Gass, Linear 
Programming, p. 83. 
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Wieseprosram ditifers trom: the primal program (1.1.1), (1.1.2), and (1.1.3) 
Onlysin»s (l.3.2), 420.5 Azo= bAtie sfearmulated in equalities, while (141.2) 


in inequalities. 


Note.) ea ele.) sand (0.3) can be eonsidered<as a 
canonical gformassiowevier wesinees GL al!) Glelw2.. and (1.1.3") is 
Braue ormedi: rom our primaleproplems(i.t,1), (121.2), and (1.1.3), fhe 
variables of its dual problem are always constrained to be non-negative. 
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5 
max Z = v*'x* = (v',0') (12451) 
x? 
subject to (A,l1I) es = b (154.2) 
x 
m2 : 
=0 Gi 4. 3) 
Oo = 
x 
= ! 
where 0 (0 Ongo7 e204) 
te) om t 
ees ta 
and the dual program turns out to be 
min W = bly (Gils) Sk) 
! 
subject to a be C Givene) 


where y is not constrained to be non-negative 


i Gass, op. cit., pp. 90 - 91. It is worthwhile to point out again the 
distinction between the transformed canonical form and the original 
canonical form. 
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However, if we make a slight manipulation, (1.5.2) can be decomposed 


into two parts 


A'y 


liv 
<q 


(QU ems) 


and 


lV 
(a) 


Ty 5574) 


Thus y is necessarily constrained to be non-negative. 


Now by the same precedure, the dual problem of (1.3.1) (1.3.2), 


and (1.3.3) is as follows 
min W = b'y 
subject to A'y =v 
where y is not constrained to be non-negative. 


This time y is really not constrained to be non-negative. The trick is 
that there is no identity matrix in the coefficient matrix, and there is 

no null vector in V vector. Consequently, we can conclude that although 
all the standard form .can be transformed into canonical form by introducing 
slack variables, the transformed canonical form still has the property 

of the standard form. Therefore we must distinguish the transformed 

canon cam pormeec.. al’) Clie. 2) and (l.1.3") from the original 


Canon Loaierormiellas yl). Clao.2)ee and (1.343). 


3. We shall discuss the maximization problem only, since any minimiza- 
tion problem can be transformed into maximization problem by 
multiplying the objective function by -1l, i.e. multiplying all the 
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CHAPTER 2 


THEORY OF LINEAR PROGRAMMING 


We have formulated the linear program in Chepcet 1. Before 
we start discussing the simplex method, we discuss the essence of the 
theory of linear programming briefly in this Chapter. We shall deal 
with convexity, feasibility, fundamental theorems, duality theoren, 


existence theorem, and equilibrium theorem. 
81. Assumptions 
First of all we make the following assumptions: 


ihe Linearity. As formulated in Chapter 1, our system is linear in 
the sense that it has the properties of additivity and homogeneity. 
By linearity we mean that a system is subject to the rules of 
addition and scalar multiplication. For instance, suppose we have a 


linear function f(x) , where x = x + Xo > then 


£ (x) f(x, + x5) = f(x,) + £(x,) 
This is the property of additivity. 
Now suppose Ay and hy are scalars, then 
£001) + hy Xo) = £(A,x,) + £(\,X5) due to rule of addition 


= Aj f(x) + At (x5) due to rule of scalar multiplication 


i Hadley, Linear Algebra, pp. -1=- 2, and pp. 133 — 134. Note this 
assumption leads to convexity of our system. 
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The rule of scalar multiplication has the property of homogeneity. i.e. 


£(A,%,) A, f(x) 


ti 


ECA, X,) Ant Oxy) 


Closedness and boundedness. Suppose we have a set 


2 


2 
T = tx] x) + x, 


< 1} 
then T is closed. T is the entire circle shown below. Any 


DOlit a e= (x, 5X») which satisfies sat as x5 See is, int... ihe 


boundary of the circle is included, therefore it is closed. 


Closedness is very important in maximization (or minimization) 
problem. If T is not closed, then the boundary of the circle is 


Wee ttcluaed ii" ©, 1.5 x + xX» < 1 . Suppose a point 


Se eee in T is very close to the boundary. If the boundary 


hi 2 


is not included in T , then we can always find a point 
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where ¢ = (¢ ) is positive and sufficiently small 


se) 


such that X +e is also in T. Thus we can never find a point 
which takes the largest or (smallest) value. Max (or min) position 
can never be reached. Our linear program is formulated in weak 


inequalities, so it is closed. 


Next, if any point x in T takes finite value, then the 
system is said to be bounded. We assume our system is bounded. 


We shall discuss bounded solution in Chapter 4. 
33 Consistency. We assume (1.1.2) is consistent, i.e. 
p(A,b) = p(A) 


The augmented matrix (A,b) , including the column vector b into 


A , has the same rank as A. The following system is not consistent, 


2x) aF 2x, s 4 
x + x 2 3 
, % 5 , Ze. : ; 
since the rank of coefficient matrix Ll is 1 , while the 
rank of the augmented matrix [3 ; i is*"2°e*"Graphicallytas 


shown below, this system is inconsistent. 


We follow the idea of Hadley. Linear Algebra, pp. 167 - 170 and 


Linear Programming, p. 78. 
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We assume linear independence for (1.1.2), i.e. 


o0(A) = m (233) 


This condition is made to ensure unique basic solutions. Assumption 
4 implies assumption 3, since an m-dimensional vector space can not 
have more than m linearly independent vectors. This assumption 
can be relaxed. However, for simplifying our discussion, we shall 


retain it. 


Non-degeneracy. i.e. we do not deal with the case where one or 


more than one zero appears in solution. We must point out that 


assumption 4 implies this assumption. However, since we shall mention 


non-degeneracy very frequently, we prefer to make it as an independent 


assumption. 


Feasibility and convexity 


We want to know the properties of the constraints (1.1.2) 


Hadley, Linear Algebra, pp. 167 - 170. 
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and (1.1.3) or (1.1.2') and (1.1.3'). When a solution satisfies constraints 
(1.1.2) and (1.1.3), the solution is said to be feasible. We can consider 
that all the solutions of our linear program which satisfies (1.1.2) 

and (1.1.3) construct a feasible set S . For illustrating the feasible 


set S , we can consider the following example. 


Example 1. 


Suppose we are to find x and Ky such that 


Z = x + X, is max (2 dee) 

subject to x) + 2x, <4 
2x) + X, =) C22 le) 

2x, Ge 0.x, 8 
x = 0 me x, 2 0 (e153) 


We plot (2.1.2) and (2.1.3) on Fig. II1, the shaded area 
OABDE is the feasible set S . The point C is not feasible. Any 


point in -S ~i1s feasible. 


Now the feasible set S is said to be convex if all convex 
combinations of feasible solutions remain in S . In fact S is convex. 
To show this, suppose there exist two feasible solutions x) and X,, 


to (1.1.2). We shall show that a solution which is a convex combination 


of X) and Xx, ae) fyeaihil shiny 4  [DYsneathax= 


am dove 4x bre 5x batt o} s16 sw spoqque 


x + x =f 
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Now Ax = 


WA 


Therefore 


2X, +X. $5 
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where AJA 2 0, and Mae eg os 1 


and x are two solutions, we have 


Ax Derands Ax 


AS 


i) 
WA 


A(A,X} + h5Xy) 
i if 5 r = 1 
ATA, X1 + (1 A Xo] since hy + ho 1 


hj Ax, + (1 - AJAX, by assumption 1 


rb a (Gi = Ab =b 


S is convex. 
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Now let us look at Fig. III. The shaded area S is convex intuitively. 


§3. Fundamental Theorems 


For our algebraic manipulation of Ax <b. We replace the 
inequality with an equality. Since A has dimension of mxn _, and 
o0(A) =m , it is in an m-dimensional vector space. We denote this space 
by Vie. In an m-dimensional vector space Ves ,» there cannot be more 
than m independent vectors. Suppose the first m columns are linearly 
independent. Then we can always solve Ax =b for the first m 5 by 
specifying arbitrary values to the remaining vectors x, = ttt int2..G <)5tl) , 
since the remaining vectors A, ( = mt+l,m+2,...,n) can be expressed as 
linear combination of the m independent vectors which form a basis for 
Nes - As a special case we can set all the remaining x =0Q. This solu- 
tion is called the basic solution. In fact this is not a special case. 
We shall show that the remaining x5 =". M+2,...,0) |must be zero in 
Theorem 2.1 and Theorem 2.2. Basic solutions cannot have more than m 
non-zero elements in it. Since we have assumed non-degeneracy, all the 
basic solutions must have exactly m non-zero elements. From the 
theory of linear algebra, we know that all the solutions to a linear 
system are the linear combinations of extreme points, or are the extreme 
points themselves. Further, all the feasible solutions to our linear 
system above can be expressed as convex combinations of the extreme 
points in S . On Fig. III, points 0,A,B,D,E are extreme points of 5 . 


Any feasible solution can be generated by the convex combination of all 


or some of points 0,A,B,D,E . 
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Now we are going to show that an extreme point has exactly m 
non-zero elements in it, and that an extreme point is simply a basic 
solution to our linear system above. Consequently, we can conclude that 
all the solutions to our linear system can be generated by basic solu- 


tions. Let us prove the following two theorems. 


THEOREM 2.1: If a solution x is an extreme point of the feasible set 


S , there can not be more than m non-zero variables in the solution. 


Proof: Our proof follows Karlin with our own modification. Suppose 
there exist m+ 1 non-zero variables (elements) in a solution, say the 


first) m+ le, Ones xe LU 


1 ee Oe er Xe Oly xX > 0, = Since 


2 m mt+1 
the rank of A is m , we can always assign an arbitrary value to one 


of the variables. Thus the solution is not unique. Since p(A) =m, 


the first m+ 1 columns of A are not linearly independent, we can 


always find a set of scalars 4G —fle2 eit) » notedilin sere, such 
that 
mt+1 
ets = Ome My 210. mpouee) =.1,2,..<,m 
Cae, 


(fe iligh jNBVeTEsS< iqVohefeheateyal 


Ai = 0 (22) 


where A = (AjAne + Ay) 


Karlin, Mathematical Methods and Theory in Games, Programming, and 
Economics, pp. 161 - 162. Alternative proof can be found in Dorfman, 
Samuelson, and Solow, op. cit., pp- 75 - 77. In Chapter 3, the idea 
of finding a new basis can be used as an alternative proof. 
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A = (AyorAgeeceoA a)! > 0 with the inequality 


holding at least once 


This is a linear homogeneous system, and o(A) =m<mtl 
Thus we can always find a vector } up to a scalar multiple. Suppose 


; 18s ee ; 
we found two solutions A and A (vectors) 
a2 
MN =e) cand dy = cA (23) 
where ¢ is a constant scalar 


Thus (2.2) can be rewritten as 


Ga) ee ee O (2.4) 
=: —2 
ACee)) (=A) = 50 
and the corresponding linear system is 
Ax = b (2G) 
Adding (2.6) to (2.4) and (2.5), we get 
= =) I = Bail 
Ax + AX® = bs or ACx + 2 )*= bd C227) 
—_ = 2 — 2 
Ax + AY =b,or A(x+A)=bD C223) 


Thus from (2.7) and (2.8) we get two different solutions (x + a%) and 


(< + pe with the m+ 1 st elements being non-zero. However by (2.3) 
SL (x ate yey + ax + 1¢),] = xX 


é 1 
This result shows that x is a convex combination of (x +.) and 
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(x + 4°), contradicting our assumption that x is an extreme point of 


the feasible set S. 
OLE. Ds 


Thus we conclude that there can never exist more than m _ non- 
zero elements in the extreme point. Now to show there is a one-to-one 
correspondence between a basic solution and an extreme point, we can 


prove the following theorem. 


THEOREM 2.2: ® If x p> OFS x, > O Ae; x 0M, er = Rees, 


; : 5 
ha O , then X is an extreme point in S. 


Proof: Suppose there exist two different basic solutions *' and x" 


so that 


ea ies (2.9) 
Ax" = b (2.10) 
where x! = (KX) Xp o+e2 9X sO > 0)" 

x (x1 X59 ° 9X0 V1 OR 


Subtracting (2.9) from (2.10) we get 
A(x' - x") = 0 C2ie1N19 


(2.11) is a homogeneous system. If (x' - x") #0 , then we can always 


find a solution, say x'" , subject to a linear transformation (by 


assumption 1) 


? Karlin, op. cit., p. 162. We follow Karlin more closely than in 
Theorem 2.1. | 
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Since (2.11) is a linear homogeneous system, ec is not unique. If 

Se Oiand eGer 8) MOM or A Se POP and (x) =eat)8 > OPO then we 
can increase or decrease ¢ arbitrarily until one element of x'" , say 
the mth element xs is equal to zero. Thus one of the first m 


columns in A becomes dependent on the remaining m- 1 columns. This 


result contradicts our assumption 4, p(A) =m. Consequently, 
(x! x x") = 0 


i.e. the solution to Ax = b is unique, then x is an extreme point 


stig, Sy 
O,u.D. 


Our assumption 4, o(A) =m _, can be relaxed. We can always drop any 
redundant rows and columns from A . However this will lead us to 


degeneracy case with which we shall not deal. 


By Theorem 2.1 and Theorem 2.2, we can conclude that there is 
a one-to-one correspondence between an extreme point and a basic solution, 
and that all the solutions can be found in basic solutions, or can be 
expressed by linear combinations of basic solutions. This conclusion is 
very important in the theory of linear programming. Since basic solu- 


tions are extreme points, any other solution can be generated by linear 
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combination of the basic solutions. Further since S is convex as 
shown in section 2, any feasible solution can be generated by convex 
combination of basic feasible solutions. Thus to solve a linear program, 


we need to find the basic feasible solutions only. 


Next we are going to show that the optimal solution is one of 


the basic feasible solutions. Let us prove the following theorem. 


THEOREM 2.3. If the value of the objective function, Ze are ttre 


extreme point is optimal, then the value of objective function at any 


other point in S cannot exceed Ze ‘ a 


; £ F ; ‘ 
Proof: Define Xo (r = 1,2,...,k) as the extreme points, i.e. basic 


solutions, in the feasible set S , where 
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ahi CRE oh gy a , if the basis r 


contains the first m process vectors. 


Here r is defined as the index number of basis, its maximum possible 


number can reach 
k= (") (2.13) 


r ; ‘ : ; 
The first subscript of Xj oot is arbitrary, depending on the combination 
of any m process vectors from n process vectors in A. Now we are 
to prove Theorem 2.3. Suppose there is a solution xX, which is the convex 


combination of Fe Sans ee Le 


6 Gass, op. cit., pp. 47 - 49. However our approach of proof is different 
from that of Gass. 
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Define Z(X°) the value of objective function as a function of xr A 


Now suppose ie is the maximizer among Xi (r ML tate at) wt Len 
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Z = = i 
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or Z(X.) = aXe) when Z(X") = z(X°) ,cr#e 
Q.E.D. 


This result shows that the value of the objective function Z(X.) at 

a point of convex combination of extreme points in S cannot be larger 
than the maximum Z(X") at an extreme point. Analogously for the 
minimum case. Thus the optimal solution must be < when 

2(X2) > Z(X,) » t # f , or some extreme points and their convex combina- 


tions when Z(K-) = Z(X°) for some r,r#f. 


So far we have come to a point where searching for an optimal 
solution it is necessary only to search from one basic feasible solution 
to another, until an optimal one is found. Then the procedure is iterative. 


The maximum possible steps of iteration are 
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independent columns from the n columns in A _ to form a basis. Further 


k is finite since n and m are finite as defined in Chapter 1. 


Thus we have obtained the results necessary for solving the 
linear program formulated in Chapter 1. Now return to Example 1 and look 
at Fig. III. The extreme points are 0,A,B,C,D,E. Here C is not in 
S , thus basic feasible solutions are 0,A,B,D,E . However it is not 
interesting to consider point O . In addition algebraically points A 
and E are not the basic solutions in the sense of bases in vector 
space Vv, . Thus we have to find two points only, i.e. B and D. Now 
the problem is to find a point from B and D such that Z=x, +x 
is max. There are only two steps. Obviously, the optimal solution is 
D , since the highest line Z = x) He Ky touches the feasible set S 


at point D. Graphically the optimal solution is the coordinates of 


Post De, .e sexe eZee x =o wandsthe line (Cor hyperplane in) 3 or 


uh 2 


more dimensional vector space) has a constant term 3, i.e. Z=3. 


§4 . Existence Theorem, Duality Theorem, Equilibrium Theorem 


Before we start discussing the simplex method, we prove the 


following theorems for subsequent analysis. 


EXISTENCE THEOREM: If both the primal and the dual problems have 


feasible solutions then there exist an optimal solution. 


Beoots ) Recall (1.1.2) andiCl.2.2) 


Ax < band Alyé2 tx 


“ Rablin, op, cit., p. 123. Alsimilar proof can: be found in Lancaster, 
Mathematical Economics, pp. 29 - 30, though the statement of the theorem 
is slightly different. 
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Premultiplyime (1.1.2 )eand (1.292) %by éy" Mand “x'artespertively, 


we get 


y'Ax < y'b (2.14) 


Transposing (2.15) we get 
ay) Ase Suri (2i015') 
By (2.014). “and (2.15%) 
Vx < y'Ax < y'b (2.16) 
or Z(x) < W(x) 


where Z(xX) = v'x as a function of x (2e7) 


WC(y) vy eas a funetion of —y (2.13) 


Suppose y is a feasible solution, then for all feasible solutions 

x , the primal objective function 2Z(x) is bounded from above. y'Ax 

is the upper bound by (2.16). Then, since the feasible set is closed 

and convex, there must exist a maximum. Now if y is not feasible, then 
for all feasible x , Z(x) is not bounded. Z(x) does not have upper 
bound, since y'Ax does not satisfies the feasibility. Similar argument 


applies to the dual objective function W(y) 


This theorem helps us investigate if our linear program is 
incorrectly formulated. However, it is difficult to judge the feasibility 


of both x and y . An easy way can be derived from the simplex method. 
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We shall discuss unbounded solutions in Chapter 3. Next we are to prove 


the duality theorem. 


DUALITY THEOREM: If the primal problem has an optimal solution, then 
there exists an optimal solution to the dual problem, and the values 


of both objective functions are equal. 


Proof: Denote the basis formed by m columns in A by B » and the 


basis which yields the optimal solution by B Suppose B contains 


f- i 


the first m columns, imi /A * 
Be = (AJA 


pt A) 


A 
~ 


where f < 


The basic equation can be written as 


BX =b (2219) 
iE © 
and the basic solution is 
es bab (220) 
Oo r 


X= Bb (2.4215 
and the value of primal objective function is 
vixt = max Z(x) (22) 
EG 


where Ve = (Vy oVooeeeoV,)! 


: Gass, op. cit., pp. 84 - 85. We follow Gass only in taking the extreme 
values of both Z(x) and W(y) . 
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Now suppose we have found the dual basic solution corresponding to the 


basis Be 


" On one Gnas 
Bry Ve ,» where y (Yp9Voo+ e+ o¥) C22 oe) 


However we do not know if y° is the optimal solution to the dual problem 


or not. Premultiplying (2.23.2) by b" , and using (2.21) we get 
tee ee tr Se me ri 1 mayer! 
bey DICH ae =" (BE b) Ve kot, (2.24) 
Transposing (2.24) and using (2.22) we get 


W(y°) = y°'b = Ue = max Z(x) (2.25) 


Now recall (2.16'), i.e. 


Z(x) < WY) 


This inequality holds even when we take the extreme values of both sides, 


cle =P 
max Z(x) < min W(y) (2.26) 


Now we can consider Z(x) and W(y) as two disjoint sets with only one 
possible point of intersection if the equality of (2.26) holds. However 
we do not know whether there exists such an intersection or not. We 
still do not know if W(y°) (y°''b) is equal to min W(y) or not. How- 
ever both W(y°) and min WCy) are in the set WY) . Now by (2.25) 


and (2.26), we have 
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Wy”) = max Z(X) < min W(y) (2027) 
However by definition we know 
Wy?) > min WY) (2.28) 
By (2.27) and (2.28), the two inequalities hold simultaneously, thus 
W(y°) = min W(y) 
i ge. y°'b = min W(y) 
max Z(x) = min W(y) 
since y°'b = max Z(X) by (2.25) 
0.E.0. 


Thus the duality theorem can be used as a criterion for 
judging the optimality. We shall return to the duality theorem in 


Chapter 4. 


Note that the notations used in the above proof will be used 
throughout our discussion of the simplex method in Chapters 3 and 4. 


Special attention should be paid to the index number of basis. 


Finally before we start discussing the simplex method, we prove 


the following theorem for later analysis. 


EQUILIBRIUM THEOREM: If x is the optimal solution to the primal 


problem, and y is the optimal solution to its dual problem, then 


: Laid, sop. Clit., bp. leo. Similar proof can be found in any book on 
the theory of linear programming, e.g. Gale, op. cit., pp. 82 - 83. 
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Since we have proved that Xo and y are the optimal solutions to 


the primal and dual problems respectively, the equality (2.31) represents 


optimality. 
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x = an nx 1 column vector 
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y is mx 1 column vector, exactly the same as y in Duality Theorem. 
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However in order to be consistent with x , we use y instead of y . 


However we must note that the dimension does not matter in 
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(2332) justifies that (2:32) is identical with (2:31), ° The reason why 
we use (2.32) instead of (2.31) is that we want to explain the equili- 
brium of the whole system, not only of a basis, though the final basis 


Be represents optimality, i.e. equilibrium. 
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This result is very useful in economic theory. 


interpret this result in Chapter 6. 
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CHAPTER 3 


THEORY OF THE SIMPLEX METHOD 


Now the next step is to solve our linear program. From 
Theorems 2.1, 2.2, 2.3, we know that if there exists an optimal solution, 
it must be one of the finite number of basic feasible solutions. We 
can try all the possible number of bases, i.e. k bases, and then find 
the optimal one among k . This is called the Complete Description 
Method. For our later discussion, we denote it by Method A. However 
by trying Method A, the computational task is tremendously tedious, 


eegy LfivA is ta«7 x 3 matrix, ‘then 


) = 308 byz (2 213) 


i.e. we have to try 35 basic«solutions. To get rid of this difficulty, 


the Simplex Method is commonly used. 


The procedure of the simplex method is as follows: Starting 
with a basis, choose one process vector not in the initial basis to 
replace a process vector in the basis at each step of iteration which 
continues until the value of the objective function reaches the optimum 


subject to an optimality criterion to be discussed later in this Chapter. 


In the simplex method, we always deal with the transformed 
Ganouveaimcormemat.e, (lelel ) Cl. 132") ande(1.1,.3). Let us discuss 
the essence of the theory of the simplex method in this chapter, and the 


computation technique in Chapter 4. 
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§1. Initial Basic Feasible Solution and Its Equivalent Combinations 
Suppose we start with the first m columns in ne » where 
A = (A, Agee +A sAL jose A) ae A wl) eeDyal <3) 
Then the initial basis is 
B = (AjAy+ +A) 4 fe See) 


The corresponding basic equations turn out to be 


34 


Hog, te a ve 0) Cae) 


Thus the initial basic feasible solution is 


xe = x = Bob: > 0 (352) 
where x = Cs saci ener Stee OTe an mx] 


column vector, which is restricted to be posi- 


tive, since we have assumed non-degeneracy in 


Chapter 2. 


(3.1) can be written as 


vector b is expressed as a positive (it must 


(s ie) 
} x,_A, = b (3 ae) 


be non-negative in general case) linear combina- 


tion of the first m independent column vectors 


in A , i.e. b is in the convex cone formed 


by the independent vectors A, (i Se ere stare th) 


in m-space, ve ° 


_ 


rm : > nel 


= 
,. = _ x x que 
eisiw ; int enmuloo m dexti ofa Hatw a2838 sw 2R0 7 
7 _ ~ 
: j p » - , yy * q 
; (E.L) “4d (I ga) - (Ae eg a Ass exh Ad eal lo 
al afead telsins of 
7 0 * 7 ¢ \- ssf A) = ee 
sd 03 390 a1u7 Sootzeips steéed guibaegserzep ae 
\ 
7 r = 1" 4 
(f 2c) - I ‘ - Ds 
} 
- eb notsnvloe sidiess? e5d Labsint sag 
‘ [- o 
(£,€) 0 « Ga Og we 4 
0 o o 
» 
ight a. a Ae 
I ms t rant eee ene ‘or’ ¥ 7 7 ed 
~tgoq sd o3 Bbs3ortxrtesx et doltdw.,i630sv nmules : 
al yoaysnsgob-non bamueas svad sw sante ,svig 
.& ts3gado 
: es ts3sthiw ad nao (L.€) 
a 5 
("L.€) d= A x | 7 
i Vs fut 
i - ap @ 
jeum 2b) svidteog s ae bseaszqzs at dd. s0358v ; - 
- 
~enidens rsanil (sass Isvopes nt svidagen-non sd 
7 ; D wn c . _ aa 7 
@1032ev aploo Scebpeqsbat m iethi sdy lo aoki SS 
= 7 = 4 =* 7 
Beer | nod ‘on | ean? 4a 
_ -baaxc sitio, xevnoo edz nt at od it» A at 
; a _— 
| ise. _ : a a 
ts wre 


bain F =D, A = snebaogaiil oda . 


bie) 


Since A, Gi = 1,2,...,m) are independent vectors in ‘be enalyy, 


vector in Ne other than A, (i = 1,2,...,m) can be expressed as linear 


combination of A, (i url. Zee fl) ee te LUS 
m 
bs, Ae eA, (3.3) 
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Wiere mj = Ter le, Mt 2, ..¢ alan , and 
xi (i = 1,2,...,m) are, not necessarily 


non-neg, called the equivalent combination to 


one unit of - 


Suppose we now select arbitrarily a vector A. et om). co 
replace a vector, A, 7 Se e-eehen., by multiplying (3.3) by an 
arbitrary positive constant 96 , which is to be determined later in this 


section, and moving the right hand side to the left hand side, we get 
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Here A. and A, (i = 1,2,...,m) are to form a new basis. We have to 
find a solution such that it remains in the feasible set S . To do so 
6 must be non-negative, since if it is negative the solutions corresponding 
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ye 8 9) ' ae ; 
PUsteLvesDy (5.2) 91 at least one x, is positive, it seems to be 


able to choose a 6 sufficiently small, such that the new solution 


still remains in the feasible set S. 


Now since A, (i = 1,2,...,m) are independent vectors in i ; 


AL is a linear combination of A, - A. ; A, F A, eS Ae A, are not 


linearly independent. Therefore the solution to (3.5), 6 and 


i 4 Oo 
(x, 6 - Ox.) (i = 1,2,...,m) are not unique. However we know Xs 6 and 


7 are uniquely determined by (3.1') and (3.3). Consequently, 6 can 
be any positive number. Suppose there is at least one ae Os aiid 


6 is very small. If we increase gradually the value of 6 , then we 


: fe) re) 
can end up with one of (XS - 6x, ) equal to zero. The vector cor- 
responding to the zero (x° - ex® ) say (x° = Ox" ) is then the 
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vector to be removed from the old basis B . Then the solution is 
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unique, since the m- 1 independent vectors and any other vector in 


van can always form a basis for hg : 


reall >the ie = Ol (ia@ el 2. os) wewithothnerstriceseinequality 


holding at least once, then we can choose a vector such as A. Eo 
replace a vector such as A, » However, in this case, the solution is 


unbounded, : since 9 can be increased arbitrarily without coming to 


a point where one of Ca - ox) becomes zero. 


Therefore boundedness is as important as closedness, convexity, 
etc. in finding optimal solution to linear program. Our system is for- 
mulated in weak inequalities, therefore it is automatically closed. Our 


assumption of linearity in Chapter 2 leads us to convexity. However 


SO 


Hadley, Linear Programming, pp. 93 - 95. Our discussion of boundedness 
follows Hadley in some points. 
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without any further assumption, our system is not necessarily bounded. 
We have assumed boundedness in Chapter 2. However we want to know what 
condition leads us to boundedness assumption. We shall be back to 
boundedness in the next section. 


§2. New Basic Feasible Solution, and Optimality Criterion 


Now, how do we determine 96 ? To show this explicitly, let 
us rewrite (3.3) as 
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xi Ay = Xo Ay + + X45 =F X ton A. 
Dividing by xe and removing all terms except A, to the right hand 


side, we get 
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Thus we can conclude that if at least one a is positive 
among all i , then it is possible to obtain a new basic feasible solu- 
tion. Further we can also conclude that if at least one ae is positive 
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bases involved, then there exists an optimal solution. Consequently we 
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that there exists a new basis which satisfies the feasibility condition. 
Since the m vectors A. and A, G #s) are linearly independent the 
solution is unique and bounded. Further we also must note that 6 may 
not be unique according to the rule (3.9), there may be more than one 
as Ge have the same minimum value. If this situation occurs, there 


is at least one zero component in the solution, i.e. degeneracy. Since 


we have assumed non-degeneracy, 6 must be unique. 


Determination of 6 determines what variable in (3.5) is to 
be zero. In other words it determines what process vector in the old 


basis is to be removed. 
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an initial basis to replace a vector in the basis according to the rule 
(3.9). Now we should like to know how to choose a vector outside the 
basis, i.e. ce » at each step of iteration, and what an optimal position 
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number, and remember the smallest coe - ae) , 
Ue=T 2s 65 ,) 18. 2eL0. 
By slight manipulation, (3.12) can be rewritten as 
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our procedure of iteration will continue. Finally, if 
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Then the optimal position is reached. Let us call (3.16) the optimality 


eri terion. 
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CHAPTER 4 


EXAMPLES AND TABLE COMPUTATION 


In this chapter we shall use two examples for illustrating the 
theory of the simplex method discussed above. In addition we shall 


discuss two techniques of table computation and an alternative optimality 
eriterion, 
81. Examples 


Example 2, ‘ 


max Z = 8x + 19x, + 7%, Care) 
subject to 3x1 + 4X, cP X, < 10 
CAR 2) 
xy + 3X5 + 3x, < 20 
X19Xq 0X > 0 CAs) 


As mentioned in Chapter 1, since (4.1.2) is in inequalities we can trans- 
form it into equalities by introducing slack variables. The introduction 
of slack variables may help us find optimal solution when there is no 
basis, formed by non-slack vectors, which yields optimal solution. Let 


us transform (4.1.2) into equations by introducing slack variables xX), 


and x then the above linear program becomes 


5 J 


= e ° ! 
max Z = 8x, + 19x, + 7%, + 0 x) + 0 Xe (45 1) 


Example 2 is an exercise in Gale, op. cit, p. 130, EXERCISE 6, We have 
changed the original vector b = (25,50)' to b = (10,20)', for the con- 
venience of our subsequent geometric analysis in Chapter 3, since it is 
difficult to draw the smaller vectors such as (1,0)',(0,1)',(1.3)', and 

(4.3)' compared with b = (25,50)' on a graph paper. 
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subject to 3x, + ee eee x te O° x 


2 | 4 5) 
Caney?) 

x1 + 3x, + 3X, + O°x, + Xe 
! 
X19%XqoXg2X Xe 2 0 (Chg see) 


There are five process vectors 


Let us try Method A first. The maximum possible number of bases is 
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We can find all the basic feasible solutions, and then select an optimal 


solution among them. Define the ten possible bases as follows: 


B, = (AjAy) » By = (AJA3) » By = (A,A,) 
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of objective function turns out to be 
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Try By = (A) A.) 
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So far we have obtained five basic feasible solutions and their 


values of objective functions as follows: 
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8 30 3 a 2 
poe (tae |r [Mamie roi *°3 
*10 3 
Thus the maximum Z is Z. =) 60° with A, and A, in the final basis. 


However, the above approach by Method A is tedious. Especially 


when the number of constraints and the number of variables are large. 


Let us try the alternative method, the Simplex Method. Suppose 


we start with B, = (A, A3) Ceeapp Lys Css.) 


2 2 
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where to avoid confusion we use index number r 
consistent with that defined in (4,2). However 

it need not be consistent. r is used to indicate 
the step of iteration in simplex method. In 

table computation to be discussed in Chapter 4 

we shall use the index number r_ as the order 


of step of iteration, 


The initial basic feasible solution to (4.4), and the value of 


objective function turns out to be 
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Then solve (4.6) for is; . xX) - € respectively. The inverse matrix 


of B, is, by using (4.3.3) 
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Now apply (3.15) for selecting a vector to be introduced into new basis, 
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A, is to be introduced into new basis. To find a vector to be removed 


from the old basis B, we apply (3.9) 
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Solve (2,33) for, the equivalent combinations to A, , Ay» and A 


ve se 
o 4 %y » and ce respectively. 
ee 
x n yal, Bota Roa of) 28/0 
ib © Peel: 9|-3 4jiql -5/9 
aL 
© 
xo os A Bota mpg fe an aes ee alas 
4 © 54 9{-3 4jyO -1/3 
34 
~ 
xO s 2 So Bota ep cd fae AY SIM -1/9 
© ~ Sa 9 |}-3 Atl 4/9 
85 
Apply (3.15) again 
5 hd 5 ieee 
Z = VoXoq + V3%91 = 117/9 
(4.21053) 
v, > 2 = a ily eos eet 
See San 
Zi = VoXoy + V3X3y, 4 
G45 22) 
ye ceca -4 <0 
5 5 5 
2. = Vo%o5 ae V3%35 at 
(4, L073) 
5 
Moar 25 i -1 <0 


All the (v, - 2) satisfy the optimality criterion (3.16). Therefore 


the optimal solution is 


5 il 

: ~20 a) 
pak Peed ed pe Cosel.) 

aed fcict0 0) 


be pe 


\ 


¢ e é 
re*e tne AN A 


~O\TEL « rex 


(r/0t.®) 
O> & = Q\Cit ~ 8 = Ss — oy . . 


(S,0L,a) 


Do 


Z. = 60 (4,11.2) 


The final basis contains A, and A. . The results are exactly identical 


with those obtained by Method A. 


Thus as shown above, by using the Simplex Method, we have found 
the optimal solution in only two steps of iteration, while by using 
Method A, nine steps (ten including the last slack basis) are needed in 
Example 2. The Simplex Method requires more computation per iteration, 
however, the most painstaking task is to compute inverse matrices of 
bases. At each step of iteration, there is one inverse matrix to be 
computed. Especially when the nether of constraints and the number of 
variables are large, reduction of steps of iteration is needed desperately. 
We shall show some efficient computation methods for Simplex Method in 


next two sections. 


Since we are trying to reduce the number of steps of iteration, 
we may wonder why we introduce the slack variables such that the pos- 
sible number of bases is increased. In Example 2, the optimal solution 
does not contain slack variables. However, we may frequently find some 
slack variables appearing in the optimal solution. The trouble is that 
we do not know whether it is the case before solving the problem, For 
illustrating the importance of introducing slack variables, let us solve 


the following linear program. 


Example 3. 2 


Example 3 is an exercise in Hadley, Linear Programming, p,. 145, 
Exercise 4 - 14, 
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maximize Z = 3x, + 4x, + X, + 7%) Cam) 


subject to 8x, phe eam ech Xe 7 


2 a) 4 
2x) te 6x, + X, iP SX), ss (Ceo 15 25) 
x ote 4x, + 5X, e 2x), an) 
xO CAL) 


Xp» Xoo X 


3° 4s 


First we transform inequalities (4.12.2) into equations by introducing 


Slack variables Xe» Xes and x_, then this linear program becomes 


6 ihe 
¢ e as e . . ! 
Maximize Z 3x, + 4X5 + X3 + 7%), + 0 Xe + O X6 + 0 Xs CAG dae) 
Subject to 8x, 5 3x, ae 4x, + x) + Xe iF O°x, +: O'x, = 7 


e e = ! 
2x) + 6x, + X, + 5X), + 0 Xe 4 Xe + 0 Xs 3) CAL 2 2) 


i] 
(oe) 


x + 4x, + 5X, a 2x), + O'x, + O° x, + Xo 


X19 Xoo X3s Xyo Xoo Xoo X72 0 (4a 3) 


If we solve this linear program by Method A, we have to try 34 
bases (35 including the basis with all process vectors being slack, i.e. 
(2D = 35). We shall solve this linear program by the more efficient 
Simplex Method to get rid of this difficulty. Suppose we start with the 


first three process vectors as the initial basis. Define the initial 


basis as 


By = (A,A,43) = (4.13.1) 
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To obtain the initial basic solution, we apply (3.1) 


HT 
BiX =b 


th ae tk 


Loe AL : 
where Xy = (79 *29°*30) 


Compute the inverse matrix of B 


1 
‘= [B,| = 189 
if 26 1-21 
Brees 30 0 
2-29 42 
1 
ig 17/189 
it 1 -1 
Xi =[%X5_ | = By > =f 45/189) > 
1 
se 263/189 


This is the initial basic feasible solution. 


To obtain the equivalent combinations to all 


i, Gee CoAT A ee Ag » and AJ swe apply (3,3) 


Lees 
BX, =A, 
ee = A, 
BAX = Ag 
B,xt = A 
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> 


Solve (4.14) for ; X, : x , and S by using By Frome(4siowe) 
Ak 
x14 -11/189 
1 ut -1 
x, = [Xp =| By A, ={ 171/189 
1 
Xa -59/189 
1 
X15 26/189 
L 1 -1 
X, = 1X55 |= BL A. =| -9/189 
iL 
X35 2/189 
1 
X16 1/189 
aL ab -1 
Xe = | Xo6 17 By Ag =} 36/189 
ab 
X36 -29/189 
xt {-21/189 
aly 
1 I -1 
Xo = |X57 |= By A, = 0 
ib 
X37 42/189 


Now apply (3.15) to determine which process vector to be 


introduced into new basis. 


Don trate sebeinde 
aro) “a's aie ace ae | 
att ate + abe ane nei, | 
hn ehcp + bee her 


(s.20.8) more Fe gates yt Sobos Gee Dh. UR tod CLM oe 
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cyt ay Te | I 
| "| esr\ee~ | 
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il ill a 
2 = ViX1y + VoXoy, + V3%3,, = 592/189 


Vy, - zy = 7 - 592/189 = 731/189 > 0 
teks Beal 1 The 
Zo = V)X15 + VoXo5 + V3%35 = 44/189 


Ve Ze PEON 44/189 ae aw anon 0 
ve Ag 1 ioe 

Ze = Vi*16 + VoXo6 + V3%3¢6 = 118/189 

Ve 7 Ze aONeI TS /1e0gena 16/1897 -00 
i. 1 aaa 

Zo = Vi¥*17 + VoXo7 + V3%37 = -21/189 

v> - zn Sy OVE (221 /1.89)e =, 21/69 > 0 


The largest positive ; - za is Vi zi, » therefore Ay, is to be 


introduced into new basis. Next let us determine which process vector 


to be removed from By ADD LY (3.9) 
a 
p= min 


Tovrea ll a > 0) 
i \x, 


26 
a 
24 


1 
since the only positive Xi is Koy ¢ 


Thus the vector in the initial basis to be replaced by A, 


is A... The new basis then turns out to be 


(4.15.1) 
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ko = |B,| = 171 
23 3 -20 
By =—-]-9 36 
7 len 53 8 
Then the new basic solution is 
oc LOL 
10 
Phe 2 <i eal ge 
Xo oH Rae be By b = C57 
2 
X49 2027 La. 


To obtain the equivalent combinations to all A 


Ae, and A, 


y, 2 
Xi oAy + Xp oA) + 


2 2 2 
Solve (4.16) for X,, A x, ; Xe 


matrix of B, from (4,155 2) 


,» we apply (3.3) again 


X_ respectively by using the inverse 


ify falladak 


= | 189/171 


BO 


yaw i ly fa 


= | -9/171 


sy Ls i 
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(4.15.2) 


(451553) 


KAS AS) 


(4,16) 
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0 
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Apply (3.15) again to determine which process vector to be introduced 


into the next new basis. 


2 2 2 2 

Zo = ViXq9 + VXy9 + V3X35 = 403/171 
Vo - 2 = 4 - 1403/171 = -719/171 < 0 

2 Z 2 2 
Ze = ViX15 + VyXq5 + V3X35 = Sy ily fl 

Zz 

v. - z = 0 - 5/171 = -5/171 < 0 

5 5 

D 2 2) 2 

Ze = V1 X16 + VyXn6 + V3%36 = 246/171 
V6 - ze = 0 - 246/171 = -246/171 < 0 

“4 2 2 2 

Zo = V)X14 + V%47 + V 3X37 = -22/171 
v= ze = Oe a2? 17) = 22/171 > 0 

p) } ; 2 
The only ua - oF which satisfies (3.15) is Vy ~.25 4 


therefore the vector not in 


basis is A We must note 


7° 


B, to be introduced into the next new 


that A 


7 Next 


is a slack process vector, 


a a ee, Oe ae bel 2 
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s $ s 
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ee a : 
QO > {fL\e- = I\I\e - 0 ai - 2¥ : 
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we are to determine which vector is to be removed from B, MADD LY on) 
again, 
2 
20 D 
68 = min{ 2 Cote a lee: 0) 
x i7 
sg 
Z 
“30 2 2 
= 2 since the only positive x HS Ps ; 
X39 ik) 37 


Consequently, the vector to be replaced with A. is A, . 


7 3 
The new basis then turns out to be 
8 ted 
Bye CAMA PAL) = 1 c2 570 (4017,1) 
3 Thy Ase 121 
io |B. | = 38 
By dk ta) 
Bey = os pas, 0 CE) 
-1 -15 38 
To obtain the equivalent combinations to all Be not in By » 2.e, to 
Ay» A, Ags and Ag ,» we apply (3.3) again. 
3 3 3 
Siig nag 728 ee 8 
3 =| 3 
x gf) + x71 344, + X7 yA, = A, (4.18) 
3 3 3 a 
coi pis aL 2, CMa yl aaa 
3 A. + 3 A, + Xa-A, @ A 
PCA AG Cy a | 
2 a Pes | 
Solve (4.18) for Xo, X3> Xe, and Xe respectively by using the inverse 


matrix of B, frome (4, 17,2) 


TE Ne > 
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Apply (3.15) again 
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= X13 = B., A. cd 0 
3 
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5 BF a 
X15 5/38 
Bale ol. 
=|x,5 1° B. os ~2/38 
3 f 
X56 ~1/38 
3} 
X16 -1/38 
Bes See ie | 
= X16 = By Ag = 8/38 
3 
X56 -15/38 
3 3 3 
1*12 + ViX49 + V7X55 = 321/338 
: m4 9321/38 = -169/38 < 0 


e150 


2 = 1 - 57/38 = -19/38 <0 


a %) 3 
V4%15 + V4X)5 + V5X75 1/38 


Zz 
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3 5 6 = 1/38 # =1/38 < 6 
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3 
7#76 7 23/38 


3 
V -_ 


oo fa 073953/30"5=) 53/38 < 0 


All the Me - z are negative, Consequently, by (3.16) we have reached 


the optimal position. The optimal solution is 


8) 
X10 B2/35 
tho {paced [oe 
5) 
XI 292/38 


which is certainly feasible. 


The value of objective function turns out to be 


The final basis contains Al» Ay» and Al. 


So far we have tried only three steps of iteration by Simplex 


Method, rather than 35 steps by Method A. 


We must note here that the final basis contains one slack 


process vector, A This result indicates that all the other bases 
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containing non-slack process vectors are less favorable than B. . orn 


other words, by employing only two process vectors, leaving one process 
vector unused, it is still more attractive than full-employment of three 
process vectors. Therefore if we did not introduce the slack vectors, 


and just tried all the possible bases by choosing three vectors from Al» 


Ans Ay» and A at each time, we would have ended up with an optimal solu- 
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tion whose Z is less than that of the above optimal solution, even 
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though no slack process vector is employed. To verify the above argument, 


we can try Method A, without introducing slack variables x., x,. amd x_, 


Soe 7 
The maximum possible number of bases is a) = 4, 
he (A,A,A3) 
By = (A, A,A,) (4,20) 
B. = (A,A34)) 
By, = (A,A,A)) 


where the subscripts of B.. need not be 
consistent with those of Ba baie (Ce aE SE ores) 


anda 45 lOve) 


The basic feasible solutions with respect to B and B are 


i 
X10 Anyp alee) 
A : oF miles 120 ae OME musi ne) (4,13,3) 
1 
X39 263/189 
3 r 
X10 10/189 
i ep also ete ep yadeines(4.15-3) 
3 
X10 45/171 
To obtain the basic solutions involving B, and By , we apply (3.1) 
to solve the following basic equations 
BoX- = b (4.21.1) 
eae) 
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howpolve: (4.21.1) and (4.21.2) for Ke and i respectively. We first 


compute the inverse matrices of B, and By, ° 


Ne |B. | = -59 

Nae |B, | = =11 
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Both x? and xX are not feasible. 


uh 3 
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b ap 116 
Lee VEX + vx + VAX = 2— 
ll TO IR LAD) 3u50) 189 
3 3 is) 84 
Vhs LNW tere + Vx + v,x =3- 
3 1°10 3830 4°40 171 
Cea) 


Recall (4.19.2), Z of the true optimal solution of Example 


stds 
z } 7. 3 84 y, 
19 ‘i Ayal 5) 


Thus without introducing the slack variables, we can not 


find the true optimal solution for Example 3. 


We shall deal with the slack variables further in next two 
sections where table computation for simplex method is demonstrated, 
The computations for the simplex method demonstrated so far is still 
tedious and laborious, especially when the number of constraints and 
the number of variables are large. Therefore a more efficient compu- 


tation method for simplex method is needed. 


§2. Basis Formed by Slack Vectors as Initial Basis 


We have mentioned the importance of slack variables in 
Chapters 1 and 2, and in the preceding section in this chapter. Now 
we are back to the discussion of slack variables again. Recall Example 


2. Suppose we start with an initial basis as 


Le. B is an identity matrix 
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Then our initial basic equations become 
Bx = b (4,22) 


or IX 


i] 
or 


We shall use the index number of basis r _ by the order of step of 


iteration... [he initial basic solution turns out to be 
X =b CARES) 


Now apply (3.3) for all aid al 2s aa so) COnObtain equivalent 


combinations 


(@) 
Box, = Ay 
(@) 
LESS ay 
BXo=A (4,24) 
o 3 3 : 
Onmx 
BAX, = A, 
(@) 
Ls 


(Theoretically we need those equivalent combinations to a not in the 


basis only), 
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Ou 
IX) = A, 
ee af 
Sm, 25 
Then 
= Oe as Oe = OFe 
Midas AS, rae hos, OM ray (4,25) 


Interestingly from (4,23) and (4.25) the basic solution xe and the 


(ame 0.0 
Ide power iel es 


are simply the column vectors b, Aj» Ay» Ags Ay» and A. 


Thus if we start with an identity matrix as the initial basis, and at 


equivalent combinations x? anaes with respect to BS 


respectively. 


each step of iteration transform each new basis into an identity matrix, 
then all the basic solutions and equivalent combinations needed can be 
found from the appropriate column vectors as in (4.23) and (4.25). 


We can make a table as Table I to show this procedure. 


On Table I at the first step (i.e. r = 0), the columns headed 
by b= and A, Gi = 1,2,...,5) represent the basic solution and the 
equivalent combinations as shown in (4.23) and (4.25). To obtain the 
initial basic equations (4.22) we can take the inner product of the 


column headed by B_ and the column headed by b_ as follows 


10A,, t 20A, = b 


where the column headed by B represents basis, and the basic solution 
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Now taking the inner product of the column headed by B 


and the columns headed by A,( = 1,2,...,5), we get (4.24) as follows 
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This is the application of (3.1) and (3.3). Next we are to 
apply (3.15). The first two components of the column headed by V 
for each r_ represent v5 of the corresponding process vectors in the 
basis. The third component represents z or b,, by taking the inner 
product of the column v (first two components) and colum a (rarest 
two components), or the colum b (first two components) respectively, 
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0 
Zz, = 3v,, HH aa Bre le 0r =) 0 
ha One Ome) 0 
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which can be found in the row of z5 On eZ 


Then the next row shows (3.15) or (3.16) with which we determine the 
vector to be introduced, or with which we can know whether the optimal 
position is reached or not, At step O the largest “a - zs is the one 


corresponding to A, . Thus by (3.15) we select A, to be in new 


basis. 


Next we have to choose a vector to be removed from the initial 
basis. By applying (3.9) we take the ratios of the elements of column 


b to the positive elements of colum A, , we select the smallest one 
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Consequently the vector to be removed from BY is A, ’ 


then turns out to be 


B, = (A,A5) 


We replace A, in colum 8B on Table I with A 
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next step r=1., 


Now we are to show how we obtain the tables for 


70 


The new basis 
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Applying (3.6.1) to obtain the new basic feasible solution, we define 
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Wemmustemoces that, all) 1.) defined by ((4.2071)<(4.26.2) and (4.26.3) for 
step r+ 1 follow those for step r . However we should replace s 


with t (fer the next table for step.r+ 1. 


To derive (4,26.1)(4.26.2)(4,26.3) for Example 2, let us apply 


(3), ") “and (3.3) 


Xi oA, + XeoAs = b Ceo.) 
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x44, + ¥eghs = A, (27s) 
ay) + Kesh = A, (4,27,6) 


Sincw we are to replace A, with A to get the new basic 


4 a 
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These are exactly what (4.26.1) indicates, and the numerical 
values are shown in column b of the second table of Table I. To obtain 
(720,72 )0 tor all) 4.* 2. ..wercanesupstitute (4,27.3)einto (4,;27.2) 


(4.27.4) (4.27.5)—€4.27.6) and eliminate A, . The elements in columns 


A Ays and A. are simply computed according to (4.26.2), We must 


1 23) 5 
note that when we substitute (4.27.3) into (4.27.3) itself to eliminate 
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which is simply what (4.26.3) indicates, and appears 


in the column A, of the second table (i.e. r #= 1) 


on Table I. 
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We must also note that the columns corresponding to the vectors 


: ; if a if 
in the new basis are unit vectors, since X59 reek (aR om Xo =O, Xo 5 a0, 
AE 
Xen = 1. Thus each time when we introduce a new vector, we get a unit 


vector. Consequently we can always proceed with identity matrix as basis 
for any r . Thus with identity matrix as basis we can continue our 
computation for r = 2,3,... as when r*#=1. Our computation will be 


iterated until 4 =" Zz, 


{ <0 fer ali. 4 


Our final table shows that the optimal solution is 


Z, 


x 10/9 
a -- a = 
X30 50/9 


by reading the first two elements in column b where r = 2, The maximum 


value of objective function is 60 by reading the element at column b 


and row (ay ) « We also found that Z increases from 0 when r = 0, 
to 47 = when r= 1, and to 60 when r=2. This result is identical 
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%19¥%q 9X3 9Xy Xo Xo 9X7 > 0 


Ape At 


We start with the identity matrix including Ac, Adak 


; r 
each step we choose a vector with the largest positive sie = Zi to 
replace a vector with 

b 


8 = min on ) for all positive a 


i 744 i) 


For Example 3 we have two steps of iteration, and the results of final 


table are exactly identical with those obtained in (4.19.1) and (4.19.2). 


Our table computation is shown as follows 
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So far we have demonstrated the table computation with slack 
basis as initial basis. However we must note that the slack basis is 
not always available, We may have an original canonical program which 
does not have identity matrix in its matrix A. In this case we may 
introduce some artificial (unit) vectors such that the initial identity 
matrix is available, There are several methods available in this 


respect. We shall follow Charnes' Method. 


83. Artificial Basis as Initial Basis 


Let us use the following example. This time it is a minimiza- 


tion problem. 


Example 4. # 
min Z= 2x, + X, ~ X37 X, CAR2 601) 
subject to X17 Xo oF 2x, nena 2 
2x) + Xy - 3x, + x, = 6 (Anco) 
x oF Xo oe X34 ae - 5 7 
X1> Xp» Xo X42 0 (4.28,3) 


As mentioned in Chapter 1, any minimization problem can be 
transformed into maximization problem by multiplying the objective 
function by -1. Thus (4.28.1) turns out to be 


' = - - 
Z 2x) X5 + X4 + x), 


2 -M Method is originally developed by Charnes. Our discussion follows 
Hagley .nOO,CLts pp. alo = 121% 
Example 4 is an exercise in Gass op. cit., p. 81, Exercise 1-C. 
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where Z = -Z 


Now since (4.28.2) is a set of equations, we can introduce 
vectors in such a way that we can start with an identity matrix as basis, 
One way out of this difficulty is to add arbitrarily an identity matrix 
to (4.28.2), and assign a sufficiently small number -M to the corresponding 
new v, 80 that the artificial vectors must disappear from the final 
basis. Since the added vectors are artificial, we must try to let them 
leave the basis as soon as possible. For this purpose we can assign such 
a negative number -M that it appears very large in Me = z4 when we 
apply (3.15). The absolute value of -M must be assigned very large in 
such a way that any number associated with it can be neglected. By 


doing so the non-artificial vectors will be chosen to replace the artificial 


vectors. Now Example 4 can be rewritten as 


max 21 = ~2x, - Xo +x, + ee Mx. - Mx. - Mx 


subject to [A,I] x 
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where I is identity matrix formed by the artificial 


vectors. 


Initially we shall find Z' is unduly small if the artificial 
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variables appear in the function. Obviously 2Z' will not be maximum. 


When x, = Xe = X= O , any solution will yield a Z' much greater than 


that when x = (tl 


ONT AS sy, 


Even if the solution is not a maximum, Z' will be much 
greater than that when any one of artificial variables appears, since 
the absolute value of M is such a large number that any numbers such 


as Vv, (i = 1,2,3,4) can be neglected. 
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On Table III, we can find Mee = z4 very large in the non- 
artificial columns, and very small in the artificial columns. This helps 
us choose the non-artificial vectors to replace the artificial ones. In 


addition the value of an = -4 -7M is greater than Z' 4 = -15M , since 


-15M < -7M , and 4 is negligible compared with M . Consequently by 


reading column b for all r , we can find the value of z' increases 
is 


sharply at each r. i.e. at each step of iteration, we have 
-15M < -4-7M < = Be ey < -2 
3 3 
5 i 
Finally when r = 3, we get Z = -2, which is the maximum 


by the optimality criterion (3.16), since at step 3 the ce - zy (for 


ahieeesel. 2, .40.7) are, nonepasitive, 


Instead of using (3.16) we can also check the optimal position 


by using the Duality Theorem which was discussed in Chapter 2. 


§4, Alternative Optimality Criterion 


; r 
First we should like to point out that the values of = 
corresponding to the initial basis, i.e. the basis formed by slack or 
artificial vectors on the final table construct the dual optimal solu- 


tion. To verify this result we write the equivalent combinations to the 


initial vectors Anant? Ann as follows 
=1 
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fi 2 
Putting all > in one format, we get an mxm matrix as 


1 te f -1 
O02 Xam BF CA rant? Antm? 
! 
Premultiplying by Ve » we get 
ot f -l 
ICS ce penne VBE Cli Anno' Antm? ey) 


where Ve is an mx 1 column vector as defined in (2.23.1) 


Transpose (2,23,2) 


Substituting in (4,29), we get 


Eye oe ea 8 f or 
Ve XX ky =) y Ava Anto** Antm? (4,30) 
However iv Ang Ay i‘) is an identity matrix, since it is the initial 


basis formed by slack vectors. 


Consequently (4.30) turns out to be 


f f f 
V (Xp Xnpo vat, = y 


xX (4,31) 


ah 
Venn 


Recalling (3.14), the right hand side of (4.31) simply indicates 


2, 93 = ntl, mH+2, ..., mim, at the final step. The left hand side is 
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the optimal solution to the dual problem by (2.27) and (2.28). 


Let us then check our results of Examples 2,3, and 4. On 
Table I, the optimal Z of primal problem is 60, while the optimal W 


of ithe dual is 


Oo 


oY, 7 10x 4+ 20 x1 = 60 


+ b 
max 2Z(x) = min W(y) 


On Table II, the max Z(x) of primal problem is 445 : 


while the min W(y) of the dual is 


12: Oe ie) ie) One Le 53 _ J 
max Z(x) = min W(y) 
On Table III, max Z(x) = -2, while 
min W(y) = jg + yee + 7 be = -2 
teil ak 
Vaal 
max Z(x) = min W(y) 


We must note that the optimal solution to the dual problem of 


Example 4 is 


Since Example 4 was a minimization problem, and we multiplied the objective 
function by -1 to transform it into maximization problem, we have to 
multiply the optimal Z by -1 again to get the true value. Therefore the 


true value of objective function turns out to be 2, and the dual optimal 
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‘ ‘ fe) 12 fo) 9 fo) -8 
solution is mG = Ti? iss ~ aa Ys = ait 


bh 


Note y3 is negative. Since Example 4 is an original canonical 
linear program, the dual solution is not constrained to be non-negative. 


This verifies our assertion in Chapter l. 
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CHAPTER 5 


GEOMETRIC INTERPRETATION 


Recall our Example 2. 


maximize Z= 8x) + 19x, + 7X, oF 0.x, + 0.x, (Cais ay) 


SUDJeCERtO x. et 4X, +x, + x, + 0.x, = 10 


Hh 3 4 5 
si ERPS) 
x) + 3x, + 3x, + 0.x) + Xo = 20 
X12 Xo9 Xg2 Xp» Xe 2 0 Cys sD) 


Before we start our geometric interpretation, we must point 
out that in this chapter we shall use point and vector interchangeably. 


Point is identical with vector in geometric sense. 


Since A* is a 2x 5 matrix, we consider a 2-dimensional 


vector space, V, » in which there are six vettors as 


3 moet oneal 
Ce ee eee alese as = Le] 


= ei mee rin) 
A, = [oJ r) A, = [J ’ b alk Spay 


The equations (5.1.2) simply state that a 5-dimensional vector 


k= ' i if 
x (x) > Xo» Xq2 Xz, x.) in vector space V5 is mapped through 


A* = (A, A, A, A, A.) into a.2-dimensional vector b = (10, 20)' in 


V, . Define a subspace of Ve as S. c Ve . Then we are going to find 


; r q et 
a non-negative vector XS in 5. such that Z is maximized, and 


BUX. = b is satisfied, where 
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Ig : 
Xo isea 82 sl) ecolumn vector as “defined in Chapter®2, and 


B. a 2x 2 matrix containing 2 vectors in Vy ; 


- rt f 
However, as mentioned before, Xx, can be considered as a 
5 x 1 column vector with three elements being zero, and 


B. can be considered as a 2 x 5 matrix with 3 columns 


being null vectors. 


In other words, we are to find a point xe in 5. such that the vector 


b lies in the convex cone formed by 2 vectors in Vo » and such that 


Z is maximum. Define Cy as a 2-dimensional cone. By a cone we mean 


that a point, say A. sel wee ee BO) tS in C, » then hiAG is 


lv 


also in C for any scalar he 0 . By a convex cone we mean that if 


2 


2° For example, 


IN ENaC! NN SEY sige MG 
af “ak 2 


y tnen oA. + A.A, eadsralso in °C 
5 cL ed: 


let us see Fig. IV. The point A, is a vector from the origin pointing 


at coordinates (3,1), point A, ate (4, 3),8point A, atu.) point A), 


Ate Cu), pole A, at] (0.1) 8. tne cone ot 6A 


egigin all the way ouc througn point. (3,1). Thus in Fig. IV, Al> 


l is the ray from the 


2hts 3Aye uae 


Now any non-negative linear combination of 2 vectors in Vo (Sain 


are also in the cone. Similarly for the other vectors. 


Vas 4 in Me , etc.) lies between the two vectors. Thus the convex 


cone formed by two independent vectors is simply the space between the 
two vectors. On Fig. IV, A, is in the convex cone formed by Ay and 


A b is in the convex cone of A and A, 7 ete. 


cork 2 


We have known in Chapter 3, there are ten possible bases for 
Example 2. On Fig. IV any two vectors form a basis, since any two 


from the five vectors in Vy are independent with each other, i.e. 


A, # oko : A, # Aad, ,» etc., where ho and hy are scalars. We can 


; , a oy} vr 

7 * tar a 
- Ei 

. 


a ) : - 7 7 
i . 7 Z 
; . 1 
. : : ; MAS a 
bas é 199qnt0, ot baniteb 25 sora aes Ls s- 
eV at arotoev S$ gnimtstaos akin go s 7 


& 8& betabiends od neo ak ,p1dted boachinea ab save 


“7 AL, 


a 


bas ,o1ss aniod etnsmeis sstds djlw soipsv mmyfos f * /- 
annaslos € sAjiw xirzem @ * S 8 28 besebtanoo Sd meso 8 


,erojosv lium gored : 


/ 7 : 
totosy efi Jeda dove a ot x tnitog # batt od 518 SW ,.BbI0w cotso at 


jet due bos . .V ot Bitoszosy S$ yd bemrot smoo xevAOS eis mt sett a? 
- ate ‘ 
tiem sy Sh0d & Y& «emo Isnotensmib-S 2.28 0 spiied ouihe Bet hgh 


BE ASA madd » .o at ee Ce ee eS A yse ,iatog 6 nis 


i 


11 Jedd asam sw sno5 xsvaoo & Yh . 0s +h teisoa yus s02 5? ot ann 


© -e 
ee 


Siqmbxe ot. 2D Reroass ek ALK + ra fedd . 9 nt sre jA,A bre 
gatioiog algiso siz mori rojnsv eet A Imtoq sdT .VI .gtt 598 8U ant 
A 2tutog EY 42 pA gniog .(€,8) 36 5 - 

‘pda mort yet of2 et A to snoo snT . (2,0) +8 cA Iniog 4) 4 


i 
Hey 
ofA VE ghd ak aurit (Eg €) sotogq dguord3 ino yew ofa Die ait 


‘ 


exodoey gsid0 edd x03 yluaiimte .snoo sis nit osfe sia ... 2 ght al 
: Ponds 7 
mi €) .V ai stojsev S$ to nobvsnidmon teonkf svitegsa-aon ¥ae oY 

+ - 7 


~ 


Mevnod sii audi? -si10j59v ows sit meswied asif (.236 , sv tik rn oe¥ 7 


a0 néewiad soege si ylgwta el eigdsey snehmeqebat owt yd bamzo? 
— 


baa A yd bswr0} seno> xsyno> sda ee ek cA «VI .git a0 -eto2sev | ws 


518 , oA reas a 10 eno> xayaos sid nt ak o¢ +a 


_ 
7 - 


tot eogad sldtesog ns2 916 stsri3 e redgqand at oom sved ie 
; ows ye sonte ,elapd B mio) 219338 ows: ae. ire 


| fet 4 Teddo pha eg i 3b wa ‘i ‘ 


) . i 


‘tye 4 A 
Ch TNL de 
- fil eer. hes 
: 7 7 4 ee 
>)’ oe hes he — _ 


ih 
ae) 
ee 
ep 
im 
— 


’ » 
A sniog .(1,£) esanakbreo5 “, : 
; : 


_ 


a 


~~ 


a 


a 6 


; 


84 


find all the basic feasible solutions from Fig. IV. As long as 
vector b lies in the convex cone of any two A, m, AGIE Si US a ear rms oe 
there exists a basic feasible solution. Looking at vectors A and 


i.e. § 3B defined in (4.2), vector b does not lie between A 


1 1 


and A, » therefore there is no basic feasible solution with respect 


to BL This result is identical with our result in (4.3.2). 
Intuitively between A, & A, ; A, & A; ; A, & Ax M A, & A; ; A. & Ay, 5 
and A, & A. » there lies the vector b . Consequently, there exist 
basic feasible solutions involving these bases, B. = (A) 43) A 

B), = (AJA;), B. = (A,A3) > BL = (A,Az) Be = (A,A,) » and 

Bio = (A, As) as defined in (4.2). The last basis Bio contains A, 
and A_ which are slack vectors. Thus, as mentioned before, it is 


S) 


meaningless to form a basis with all component vectors being slack. 
Therefore we can conclude that, by looking at Fig. IV, the basic 
feasible solutions to be found involve only B, A B), ‘ B. “ BL sand 


By - This conclusion is exactly the same as in (4.3.24). 


1 , 
Since there are two vector spaces, Vy and V5 » in regard 
to the linear transformation (or mapping), A*x* = b (5.1.2), we can 
solve this program geometrically either in terms of Vy , Or in terms 


of V. é 


Geometric solution in terms of 5-dimensional space V5 was 
shown in Chapter 2 by Fig. III. Now we shall solve this linear program 
by Method A geometrically in terms of Vo » Since intuitively we have 
known there are only five basic feasible solutions to be checked. (We 


must note that the possible steps of iteration are still ten). Let us 


iaadi ey calls V, requirements space, and V 


Linear Programming, p. 158, and p. 162. 
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Starth with B, = (A,A3) - We are to find a set of non-negative 
scalars % and AG on Fig. IV’ such that the condition 

2, 2) 

Ay + AA, = b (os 2) 


is satisfied. In other words, we are to find a linear combination 


of A, and A, with coefficients Me : a > 0 such that vector b 


is in the convex cone of A, and A, ; 


We can use the Parallelogram Law. Form a parallelogram with 
the ray between the origin and the point b = (10,20) as diagonal, 


and draw a line from b extending downward to the left, parallel to 


the ray from the origin through point A, = (350), thenvdraw a ,line 

from b downward parallel to the ray from the origin through point 

A, = (1,3) . Thus we can find two points of intersections at as, 
2 : ; 2 h 2 ; 

and h3A. tee at Lhe points Ay times of A, and h3 times of 


A, » we can find a unique, positive (non-degenerate) linear combination 


of A, and A, » such that (5.2) is satisfied. Thus the parallelogram 


2 2 
turns out to be O MAY b A3A., ° 


By reading Fig. IV, the point =I is 11/4 times of A 


ote 1? 
and aA, is 61/4 times.of A, . This tesult is identical with 
(4.3.4). Consequently a and 1G can be identified as Sh and 

2 , 
X30 respectively. 


The next basic feasible solution involves By, = (A)4,) . 
4 
Similarly as above we can form a parallelogram Ona, b eA. where 


5 4 
points NTA, and Nea are the intersections we want. Point AWAY 
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ds 3 1/3 times of A, » and point Nea is 16 2/3 times of A 


5 
intuitively on Fig. IV. This result is also identical with (4.3.9). 
4 4 , jae 

Thus Ay and de are identified as x and Xe respectively. 
Similarly for B. : Bo and Be we find 

5 he ee ee ee) 

Lie Loe ee ee LL eee) 

8 Ms 8 8 il 8 

Xr = — = ° = — = 

3 65 X30 3 di, 35 x0 by (4.3.20) 


Finally we can find the maximum value of the objective function 
by multiplying the above solutions by appropriate as then choose the 
largest product. We find Z. = 60 is the max. This is identical with 


our result in (4.3.24). 


Now let us discuss the geometric interpretation of the simplex 
method. The mechanism of simplex method mainly involves obtaining 
equivalent combinations, applying (3.15) and (3.16) to obtain Y; ~ z : 


etc. All these procedures involve the values of v and Z. ; Con- 


vce 
Li) 


sequently we shall use a 3-dimensional diagram by adding one dimension of 


the values Vao2y and Z to the above V, . We can rewrite (5,1,.1), 
and (5.1,2) as follows 4 
na 
34110 [i F10 
es woe ee | X3 =| 20 ney) 
219.7200 x), [ z 
#5 


é This kind of expression is very common in the theory of the simplex 


method. We follow partially Hadley, Gass, and Charnes, Cooper and 
Henderson. 
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or ! x = Oro.) 


For each possible basis, we can write the basic equations as follows 


|e] x = b™ (5.4) 


where b = (bZ )', an (m1) x 1 column 
ie 
vector, and r still represents the index 


number of the basis. 


(5.4) is equivalent to (3.1) except the fact that the vector space ie 


now becomes V A 


mt+1 
Rewrite (3.3) in terms of the new vector space M tl as follows 
(Mp 
Kaks =| Gy 
VN] a 


ie@fe EWLIL AN. jayeye abe 18 
4 G 


Now let us follow the procedures in Chapter 4 closely from 
(4.4) through (4.11.2) . Thus we start with a basis B, = (A,A3) as 
defined by (4.2), and rewrite (4.4) and (4.6) by applying (5.4) and 


(5.5) respectively as follows: 


A. =b (5,6) 


To avoid confusion we use the index number r 
consistent with that defined in (4.2) for our 


purpose of interpreting Example 2. 


; * =. 7 ~ 
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and x 


xy Ay + x3 1A4 = A Chia) 
Sl teeny 
STieNe Se ak RG 
a 
co |e , 
where A, = ; SEP eS (eae 18) 
4 Ze 
j ig i) PA 


Now we can express (5.6) and (5.7) on a 3-dimensional diagram as Fig. V. 
On Fig. V the third axis represents Vie z, mana Z » while the first 
and second axes remain the same as on Fig. IV. However we must note 


that all the axes still represent pure number. 


On Fig. VG > ithe polyhedron (0 A, A, A,) ,» is the convex cone 


A and A 


formed by Ay » Ay > 3° 


We must note that the convex polyhedral 
cone) Ce as not #esteicted to that shown on Fig. V. It must include the 
extension straight out all the way beyond that shown on Fig. V. In 

other words C contains not only the linear combinations of A, with 
coefficients he page Sy me eitemay also .contain all the linear 
combinations of A, with s > 0. However, for our purpose of 


intuitive interpretation it is better to draw C as shown on Fig. V 


(i.e. Os X, s 1). In addition, other convex cones can also be formed 


(eae ieee 5): 


On Fig. V, A, are simply the projections of Ne or A, 
We must note that A, here are 3-dimensional vectors with the third 


components being zero, and that iN, and A differ from A, only in 
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the third components. On Fig. V, the vertical lines joining A, 
and A, represent Vis while the vertical lines joining A, and 


44 represent Hi » Similarly the vertical line joining by and b 


represents Z.. 


Now we are ready to interpret Example 2. We have started 
with B= (A,A,) » Suppose we have found the basic feasible solution 
x? as in (4.5.1). Then in the 3-dimensional vector space, one face 
of C formed by A, and A, ,» will intersect the vertical line through 
b upward at a point Ae - This point determines Z, = 53 3/4 which 
is the result in (4.5.2). Thus the 3-dimensional vector 
oe = (10, 20, 53 3/4) must have passed along one face of C formed 
by Ay and A, : This means that the basic solution obtained is 


non-negative, i.e. feasible. 


The next step is to select a vector not in the initial basis 
By to be introduced into the new basis. Suppose we have applied (3.15) 
and: found all z ere. ome os shown in) (4. a. 8). (40/42 )seand. (4.7.55). 


We can find all 2z~ we lsat oethesthird coordinates of points 


J 
As é A Apr rhczhs Val AC on Fig. V.. The vertical distances between AS 
dA ie d A \e and A represent v, - “ Vv, - 2 
an ee 4, an 4,2 AS n 5 Pp e 2 aoa A Mee 
and Vix = ze . We must note that the term vertical "distances" between 


two points A, and A is not used in Euclidean sense, it is simply 
= r 
the difference between the third components of Pe and He : 


Consequently we do not deal with absolute value. 


Now A, and A are simply Ay, and A, themselves, since 


oy 
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Be 


the third components of A, and A. arenzeros. 1.c. ERS ie Oi 
Thus the vertical distances between A, and A A A. and AS 

are negative. The only positive V4 - zs is ogo 2 » Lepresented 
by the distance between A, and AS - Therefore, the vector not in 


B, to be introduced into the new basis is A, 5 


Next we are to determine the vector in B to be replaced 


2 


with A, . Suppose we have applied (3.9) and found a 6 as shown in 


(4.8). © is found such that the new basic solution is feasible. In 
Our geometric term, 9 is found such that the vector b lies between 
and A 


A and one vector from A Intuitively b does not lie 


2 i at 
between A, and A, » while does lies between A, and Ay « Therefore 
the vector to be removed from the initial basis B Sa. Louse coe 


2 i 


new basis turns out to be B. = (A,A3) : 


Now suppose we have found the basic feasible solution ce 


as shown in (4.11.1). Then in terms of our 3-dimensional vector space, 


the face of C formed by A, and A, ae 0) ALA, » will intersect the 
vertical line through b upward at be which determines Ze = 60. 


This result is as shown in. (4.11.2). The. point a must be higher 


than point Ke » Since we have introduced a new vector A,  kahisiel 


V5 > 2 > 0 , into the new basis in such a way that O(v, - 25) > 0 
Byeta.ia). in fact Z = 60 > Z. =953°3/4". “Lhue the vector 

ie = (10, 20, 60) must have passed through the face of C formed by 
A, and A, 


A 8%. 10 A.A, - This indicates that ta is a linear 
a 


2 
combination of mM nd A, with coefficients ce > 0 ,di.e. feasible. 
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Remember we are considering non-degenerate case, otherwise it is non- 


negative. 


Next suppose we have applied (3.3) again, solved (4.9), 
applied (3.15) and found z3 and wi - z 5 jp Is hts). Stas shown tin 
Creel ) See and. 2) 2 -eeand PECar 0), 3) HftThen tagain ‘intuitively jon 
Fig. V, the vertical distances between A, and a; again represent 


GSr15). Pinis*time we fcan “find 'that .all .the ;points A; Bape 22 9538; 


are above the points A, » ff F4zRse7 tres 


Our optimality criterion (3.16) is satisfied. The point 


Be is the highest point on the vertical line through b upward. 


This linear program is solved. 
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CHAPTER 6 


ECONOMIC INTERPRETATION 


Now let us interpret the preceding analysis in economic 
sense. Consider a linear program of production. Recall (1.1.1'), 


@izi.2'), and (1.1.3') again. We can,consider a case where a firm 


has n_ processes of production Ay» Ay Aon A. and each process 
produces one product with m limited resources bi> bo, AES ba 
available. The firm is to determine a level of activities of 

rod tio eee 

p uc NX)» Xo » xX such that the total revenue Vi*4 + VoXo oA 
sett Ue SN is maximum, where V4 is the revenue of unit level of 
production activity se » The firm also owns m_ slack processes 
A A e@®oo 6 i i i 

nt]? nto? Alam This means that the firm can decide to 


produce nothing by leaving the processes unused, if it is not profitable 
to engage in production. The component of AA GF BE pace ees 
aj. , can be interpreted as the quantity of resource by required to 


operate one unit level of process =F . It is determined by technology. 


The problem is to find the maximum total revenue. We can 
solve by either Method A , or Simplex Method. If we use Method A, 


there may be 


n+m 
( n 


Ne fy oh ES) 


The firm can select one set of activity levels which yields the largest 
total revenue. However as mentioned before, this method is not efficient, 


though good for understanding. 
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Now the Simplex Method is employed. Suppose the firm starts 
programming with the first m processes in operation. The firm is 
to choose one process not in operation to replace a process in 
Operation in sucH a way that the total revenue is increased. Suppose 
the first basic solution is feasible, i.e. the first set of activities 
a Gis Le 2yeonuds @)) isenotuatinegative level,sandsis technologically 
feasible. Then by applying (3.3) and (3.15), the firm can choose a 


process to be operated. 


Application of (3.3) is simply to find a combination of 
activities of the initial processes such that it is equivalent to one 
unit level of activity of the new process ss - In other words when the 
new process is introduced into operation, there will be a change in the 
level of activities of the old processes. This change when one unit of 


level of activity of the new process is introduced can be calculated. 


Now suppose the idle process to. be introduced is A. ,» then 
the revenue of unit activity of A. is Ves -  On*the*ether® hand! the 
value of equivalént combination of activities of processes in operation 
is 


Wo r= 0 
Ca Ie ise 
7, 212 


This is what .(3.14) indicates. ze can be interpreted as the cost of 


introducing a new process. 


I this is called equivalent combination throughout our discussion of 
the theory of the simplex method. Dorfman, Samuelson, and Solow, 
Oporcit., -p.ela0. 
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Next the firm is to compare Vv, and Z, » i.e. to compare 
the revenue contributed and the cost incurred by introduction of one 
UunItAOf processimAs hO toa vie> a ore ey = a > 0 then it is 

tL t cee E t : 
profitable to introduce the idle process A. into operation. Thus 
Vio- Zz can be considered as the profit contributed by introducing 
one unit of process A. - However, how did the firm choose A. At 


random? No, definitely not. The firm has to compare profits 


vj = Z for all idle processes = (j > m) . (We must note that in 


table, computation we check all v4 = zy FOrma ee = (CL ler, act em) 


The process to be introduced is then the process with the largest 
positive te = zy among all idle processes ae > Jn other words, 


the profit contributed by one unit activity of A. is the largest 


among all idle processes. If v, - ze 00.) chien A. will not be used, 


t 


since the introduction of A. will bring the firm loss. 


Now the firm is to replace a process in operation with A. 
The application of (3.9) is simply to determine the new operating 
processes such that the new level of activities qf production is 
technologically feasible and non-negative. To interpret this step, 
feemus look at lables il. "At step 0, the process to be introduced 
is A, » and the process to be removed is Ag as circled. Suppose 
the firm uses only process A, » Then the firm at most can produce 


//1Seunits@oL-commodity “4, with ~/*-+units of resource by pwore=3y5 
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unit of commodity 4 with 3 units of resource by “or @c72 anits 


of "commodity 4 “with “8**units of resource by - In order to make ‘the 


production of commodity 4 technologically feasible, the firm must 
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choose 3/5 unit of commodity 4. i.e. the technological require- 
ments for all resources by 4 by . b3 must be satisfied simultaneously. 
If the firm decides to produce 7/1 units of commodity 4 , resource 
by can satisfy the decision, while resources b and b can not, 


Z 3 


since with bo only 3/5 unit of commodity 4 can be produced, and 
with b, only 8/2 units of commodity 4 can be produced. Then the 


process to be removed is A¢ which corresponding 3/5 on the table. 


However we must note that at the steps after r=0, this 
interpretation will not work, since at step O the table represents 
the resource vector and the coefficient vectors, and at the same time 
represents the basic solution and equivalent combinations. While at 
the steps after r= 0, the tables represent equivalent combinations 
and basic solutions only. Nevertheless, for our purpose of explanation, 


it does no harm to interpret as at step OQ. 


The steps of iteration continue until all the Mj - 2) < 0). 
In other words, the firm keeps on replacing a process in operation with 


a most profitable idle process until no idle process can be found 


profitable. This is simply what the optimality criterion indicates. 


Next let us interpret the dual program. Remember that the 


coefficient matrix of (1.2.2) is transpose of A. Let us look at the 


SenstLeints (leZa2') , Ay 4 j (tem GLa cee Me are the quantities of 
all resources b, (ipael 0345, mi) required, to produce one unit of 
commodity j . The constraint for commodity j is 


} 
Bey 5 ee V. (6.1) 
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The problem is to find a set of Ya (2) =. Ls see such that 


Ce ek em ie ands Gl, 2h) a are csatdst iad, 


The set of variables yy (1 = Lois, Me: ds,subject, to 
interpretation. The left hand side of (6.1) shows some linear 
combination of the quantities of m resources needed to pperate 
one unit level of process AS » while the right hand side is the 
revenue contributed by one unit level of process oe - To have the 
values of both sides consistent, it is plausible to interpret an 
as some sort of price ‘ eb vaudgings (1.2.1) )s «the value, of. the 
objective function, it is appropriate to interpret y, as the costs 
of resources by (9. eels 2tyaes <> 56 and 1 Le. Wer.can.dinterpret..the. dual 


program as follows 


The firm is to find a set of costs (or shadow prices) of 
resources (or inputs) such that the total cost of production 


is minimized subject ito.the constraints:(1.2.2') and (1..2.3"). 


Thaminterprotat tongOl aleiace )  OrialO)1)) tO al lode Sh), a am 
n is not an easy one. Some theorists of linear programming leave tunis 
task untouched. Many have tried this task, but still left some 


controversial points. K. Lancaster interpreted (6.1) as follows 


"The constraints of the dual express the fact that if the 


value of inputs incorporated into a product were less than the 


Boaeiee Samuelson, and Solow, op. cit., p. 43. 
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price of the product, it would be more profitable to produce 


and sell the output. than to sell the resources." 


This interpretation would be plausible, if the firm had 
two alternative jobs, one to use the resources to engage in production, 
the other to stop production and to sell the resources. However, if 
this is the case, then the dual problem is not the dual of the primal 
problem. It is an independent minimization problem. In other words, 
the dual problem and the primal problem should exist simultaneously, 
not alternatively. If we follow Lancaster, and if the firm takes the 
first job, i.e. use resources and produce commodities, then there does 
not exist an optimal solution. According to his argument cited above, 
it seems that the firm will produce and sell its products, if the dual 
constraints are not satisfied. However, we argue that the dual 
constraints and the primal ones must be satisfied simultaneously even 
if the optimal position is not yet reached. The two problems are simply 
two faces ‘of one problem. Otherwise the dual problem would be an 
independent primal, not a dual, problem. Similarly, the same argument 
applies to the case where the firm takes the second job, i.e. to 


stop production and to sell its resources. 


Now we would like to try our own interpretation of (6.1). 
Our primal constraints state that the utilization of resources in 


production should not exceed the limited amount of resources available. 


>) ancaster, op. cits, p. 35. I am responsible for criticizing Lancaster. 
There are many different interpretations of the dual program. e.g. 

.Baumol interpreted y as the accounting prices of the resources, and 
the dual constraints as a statement of no-accounting-profit requirement, 
William J. Baumol, Economic Theory and Operations Analysis, second 
edition, pp. 107 -— 110. 
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But the dual constraints state that the cost of resources (inputs) 

used in producing one kind of commodity must not be less than the 

price of the commodity. This seems paradoxical at first sight. 
However, mathematically, if a maximization problem is bounded, it is 
bounded from above in the usual case. On the other hand a minimization 
problem is a problem bounded from below. Now economically, a profit- 
maximizing firm must be subject to some limits. The firm can increase 
cost or loss freely without limitation. Therefore, when the firm is 
considering a production program, it can either expect low profits 


among the CaES 


alternative programs, then the job of programming 

is to find one program which yields the largest profit, or expect high 
costs, then find one program with lowest cost. Thus Y, can be 
interpreted as expected price of b; » Finally according to.the 
Duality Theorem, max Z(x) = min W(y) at optimum, In other words, at 


optimum total revenue is equal to total cost, or zero profit. This is 


simply a state of competitive equilibrium. 


So far it seems that the firm incurs losses all the time except 
when optimal position is reached. However, in production programming 
(linear) there is no time dimension included. The programming is static 
in the sense that it does not involve any adjustment process. We must 
distinguish the dynamic mechanism of market adjustment from the 
programming iteration for searching for optimal solution in the static 


sense. 


Thus we can interpret our production programming as that by 


assuming competitive equilibrium, the firm is to find an optimal level 
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of production activities among the GS) alternatives defined in 
(2.13), such that it satisfies the condition of competitive equilibrium. 


The firm would not incur loss in actual production. 


Finally we can use the Duality Theorem and the Existence 
Theorem to express a state of competitive equilibrium. i.e. the 


Duality Theorem represents a state of zero profit 


Total revenue = Total cost 
In regard to the Existence Theorem, we can interpret 


Gaon If x > 02), then Aly*+= 0 


Aly =v 'then °'x ='0 


as that production at positive level will just cover the cost of 
production, while no production will be carried on at a loss. Further 


we can interpret 


Cp yet ASS <.~b8: then’Y ys =<0 


and y>Q , then Ax=b 


as that the resources not used up are free goods, and the resources have 


positive prices when all the resources are fully employed. 


This simply indicates a state of competitive equilibrium. 
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